QVAC-17697 Prepare docs website for AI agents#1715
Merged
Conversation
…d in JSON and infra envs like GH Actions
gatteo
requested changes
Apr 23, 2026
gatteo
left a comment
Contributor
There was a problem hiding this comment.
The current llms.txt file does not provide info about the pages in the site, only redirects to llsm.txt - We should update the llms.txt to be an index file with links and descriptions of all pages in the doc website.
You can take inspiration from here: https://llmstxt.site/
Contributor
Tier-based Approval Status |
gatteo
previously approved these changes
Apr 30, 2026
gatteo
approved these changes
Apr 30, 2026
NamelsKing
approved these changes
May 1, 2026
Contributor
Author
|
/review |
Contributor
Author
|
/review |
Proletter
pushed a commit
that referenced
this pull request
May 24, 2026
* doc: create Cursor rule for docs website * docs: add robots.txt to website * doc: website source - refactor - standardize env vars to standard used in JSON and infra envs like GH Actions * doc: website source - add autogen sitemap.xml * doc: website source - add JSON-LD * doc: frontmatter improvement - add type of page to enrich metadata * doc: content update - add missing frontmatter field for SEO * doc: website source - robots.txt - add AI bot rules * doc: website source - simplify SEO machinery * doc: website source - robots.txt - add content signals
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Goal
Prepare the website for AI agents.
We are using the following tool as the benchmark:
https://isitagentready.com/docs.qvac.tether.io?profile=content
The scope covers everything that was possible to do while keeping the website static and served by a CDN.
If the migration from CDN to a Node server is accepted, the next PR will include that migration and we will add the missing tools.
Scope
robots.txtautogeneration following RFC 9309sitemap.xmlautogenerationTask
https://app.asana.com/1/45238840754660/project/1210688448662730/task/1214145679658308?focus=true
Test in staging env:
https://docs.qvac.tether.su/robots.txt
https://docs.qvac.tether.su/sitemap.xml
For JSON-LD, use browser tools: